TRANSIENCE, RECURRENCE AND SPEED OF 
DIFFUSIONS WITH A NON-MARKOVIAN TWO-PHASE 
"USE IT OR LOSE IT" DRIFT 

ROSS G. PINSKY 

Abstract. We investigate the transience/recurrence of a non-Markovian, 
one-dimensional diffusion process which consists of a Brownian motion 
with a non-anticipating drift that has two phases — a transient to +00 
mode which is activated when the diffusion is sufficiently near its run- 
ning maximum, and a recurrent mode which is activated otherwise. We 
also consider the speed of a diffusion with a two-phase drift, where the 
drift is equal to a certain positive constant when the diffusion is suf- 
ficiently near its running maximum, and is equal to another positive 
constant otherwise. 



1. Introduction and Statement of Results 

Over the past fifteen years or so, tliere lias been mucli interest in tlie study 
of the long term behavior of various random walks with non-Markovian 
transition mechanisms, such as random walks in random environment, self- 
avoiding random walk, edge or vertex reinforced random walks, and excited 
(so-called "cookie") random walks. See, for example, the monograph [13| . 
and the survey articles [U] and [7], which include many references. Non- 
Markovian diffusion processes analogous to excited random walks have also 
been studied (see [2], [3], [12]), as well as so-called Brownian polymers, which 
are non-Markovian self-repelling diffusions, analogous to certain negatively 
reinforced random walks (see [3j , [1] , [8] , [5] ) . In this paper we investigate the 
transience/recurrence of a non-Markovian, one-dimensional diffusion process 
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which consists of a Brownian motion with a non-anticipating drift that has 
two phases — a transient to +00 mode which is activated when the diffusion 
is sufficiently near its running maximum, and a recurrent mode which is 
activated otherwise. We also consider the speed of a diffusion with a two- 
phase drift, where the drift is equal to a certain positive constant when the 
diffusion is sufficiently near its running maximum, and is equal to another 
positive constant otherwise. 

Let and b^{x) be continuous functions on R which satisfy 

(1.1) 

/PX /"OO PX 

exp(— / 2h^ {y)dy)dx = 00, / exp(— / 2b^ {y)dy)dx < 00; 
-00 Jo J Jo 

/px poo px 

exp(- / 2b^{y)dy)dx = 00, / exp(- / 2b^{y)dy)dx = 00. 
-00 Jo J Jo 

As is well known [lOj, the one-dimensional diffusion processes correspond- 



are 



ing to the operators C'^ = ^£7 + b'^ ix)£ and = ^-£7 + b^{x)^ 
respectively transient to -|-oo and recurrent. Let 7 : [0, 00) — )■ (0,cxd) be a 
continuous function satisfying 

7 > 0, 7' < 1 and lim (x — 7(2;)) = 00. 

For a continuous trajectory x{-) : [0, 00) — )■ R, let x*{t) = maxo<s<tx(s) 
denote its running maximum. We define a non-anticipating, non-Markovian 
drift 6(t,x(-)) by 



(1.2) 6(t,x(-)) 



b'^{x{t)), if x(t) > x*{t) --f{x*{t)); 
b^{x{t)), if x{t) < x*{t) - 7(x*(t)). 



We consider the diffusion process X(t) that satisfies the stochastic differen- 
tial equation 

(1.3) X{t) = xo + W{t) + / b{s, X{-))ds, 

Jo 

where W{-) is a Brownian motion. Existence and uniqueness for this sto- 
chastic differential equation follow from the standard theory for classical 
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diffusion processes (see section 3). We call the solution to ()1.3p a diffusion 
with a two-phase "use it or lose it" drift. 

For example, the process X{t) might represent the price of a stock. As 
prices rise, people are encouraged to buy, creating a certain trend represented 
by the transient drift. In addition to this underlying trend, there is a random 
fluctuation represented by the Brownian motion. These random fluctuations 
might cause prices to slump. If the slump becomes sufficiently large, it 
discourages buying, which creates a new weaker trend, represented by the 
recurrent drift. When random fluctuations eventually result in prices rising 
to levels close to the previous high, the original stronger trend reasserts itself. 
With similar reasoning, the process X{t) might measure sales figures for a 
trendy brand product, or some other measurement of the general Zeitgeist. 

We call 7 the "down-crossing" function. For the majority of the paper, 
we will consider the case that the down-crossing function 7 is a constant. 
In this case, at any time t, the diffusion X{t) will run in the transient mode 
if and only if X{t) > X*{t) — 7, or equivalently, if and only if by time t 
the path X{-) has not down-crossed an interval of length 7 whose left hand 
endpoint is larger than or equal to X(t). 

The various equivalent definitions of transience and recurrence for classical 
non-degenerate diffusion processes hold for the diffusion with the two-phase 
drift. (This will be clear from the construction in section 3.) We state here 
the standard definitions, although we will use other equivalent definitions 
in the proofs. The diffusion with the two-phase drift is recurrent if for any 
pair of points xq and xi, the process starting at xq almost surely returns 
to xi at arbitrarily large times. The diffusion with the two-phase drift is 
transient to +00 if starting at any xq, the process almost surely satisfies 
limt^ooX{t) = 00. 

Our first result concerns the case in which the transient drift is constant: 
b'^{x) = b > 0, and the recurrent drift satisfies a regularity condition; 
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namely, that the drift 6^ V is also a recurrent drift. In this case, the 
diffusion with the two-phase drift is always recurrent. 

Theorem 1. Assume that the down- crossing function 7 is constant. Let the 
transient drift be constant: = b > 0, and assume that the recurrent 

drift b^ is such that the drift 6^ V is also recurrent. That is, assume that 
the condition satisfied by b^ in p.2|) is also satisfied by b^ V 0. Then the 
diffusion with the two-phase drift is recurrent. 

Remark. Note that the diffusion with the two-phase drift is recurrent even 
if the recurrent drift b^ is just border line recurrent — for example, if for 
sufficiently large x, b^{x) = 2b is the drift of the radial part of a two- 
dimensional Brownian motion. 

Maintaining the constant transient drift, but choosing the recurrent drift 
b^ to take on very large positive values at most locations, and compensating 
to insure recurrence by having it take on even much larger negative values 
at other locations, we can construct a diffusion with such a two-phase drift 
that is transient. 

Theorem 2. Assume that the down-crossing function 7 is constant. Let the 
transient drift be constant: b^{x) = b > 0. There exists a recurrent drift b^ 
such that the corresponding diffusion with the two-phase drift is transient. 

We continue to assume that the down-crossing function 7 is constant. As 
noted above, b(t,X{-)) = b'^{X{t)) if and only if by time t, the path X{-) 
has not down-crossed an interval of length 7 whose left hand endpoint is 
larger than or equal to X{t). Now if the transient diffusion corresponding 
to is such that it almost surely eventually stops making down-crossings 
of length 7, then the diffusion in the two-phase environment will eventually 
stop making down-crossings of length 7 and will eventually be driven just 
by the transient drift; consequently, it will be transient. In [11] we proved 
the following result. 
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Theorem P2. Consider the diffusion process corresponding to the operator 

i. Ifh'^{x) < i^\ogx + ^ log*-^^ X for sufficiently large x, then the diffusion 
almost surely makes 'y- down- crossings for arbitrarily large times; 

ii. If }F{x) > ^ log a; + ^ log^^-* x, for some k > I and for sufficiently large 
X, then the diffusion almost surely eventually stops making down- crossings 
of size 7. 

In light of Theorem P2 and the paragraph preceding it, in the case of 
a constant down-crossing function 7, if 6^ satisfies the condition in part 
(ii) of the theorem, then the diffusion with the two-phase drift is transient, 
regardless of what the recurrent drift 6''^ is. 

Continuing with a constant down-crossing function 7, we now let the 
recurrent diffusion be Brownian motion, that is, = 0, and determine what 
the threshold growth rate is on that distinguishes between transience and 
recurrence for the diffusion with the two-phase drift. 

Theorem 3. Assume that the down-crossing function 7 is constant. Let the 
recurrent diffusion be Brownian motion: b^ = 0. 

i. Ifb^{x) < ^ log^^^ ^ + ^ log^^^ X, for large x, then the diffusion with the 
two-phase drift is recurrent; 

ii. If b^{x) > ^log^^^a; -|- ^ log^^^ x, for large x, where k > 1, then the 
diffusion with the two-phase drift is transient. 

We now consider the case that the recurrent diffusion is Brownian motion: 
b^ = 0, that the transient drift is constant: b^{x) = b, but we allow the 
down-crossing function 7 to grow with x. We determine the threshold growth 
rate on the down-crossing function that distinguishes between transience and 
recurrence for the diffusion with the two-phase drift. 

Theorem 4. Let the recurrent diffusion be Brownian motion: b^ = 0, and 
let the transient drift be constant: b'^{x) = b. 
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i. If the down-crossing function 7 satisfies 7(x) < ^ log^^^ log*-^-* x, for large x, 
then the diffusion with the two-phase drift is recurrent; 

ii. If the down-crossing function 7 satisfies 7(x) > ^ log^^^ log*-^^ x, for large x, 
where k > \, then the diffusion with the two-phase drift is transient. 

We now make one major and one minor change in the setup we have used 
until now. Let the two-phase drift b{t,x(-)) be given by (|1.2|) . with = b, 
with 7 constant, and with the recurrent drift b^ replaced by the transient 
constant drift c. The case c G (0, b) is more in keeping with the theme of this 
paper, but the case c > b also has an interesting aspect. In particular, for 
the case c = 00, described below, the dependence on the diffusion coefficient 
is worth noting; thus, we will consider the operator 



where b{t,X{-)) 



6>0, if >X*it)-r, 
00, if < -7. 
The next theorem gives the speed of the diffusion in this two-phase drift. 



Theorem 5. Consider the diffusion in the two-phase drift corresponding to 
the operator L in (11. 4p . The speed of the diffusion X{t) with the two-phase 
drift is given by 



r X{t) / c e— - 1 

lim^ = (— ^ ]h a.s. 

- 1) + {b - c){l - e-^ 



t^oo t 



2b-/ 

Remark. Let d{b,c,j,a) = — 2F9 — ^^'^ " wr- ^ ^ (0)^)) 

c{e~ -l)+(b-c){l-e~~) 

we call d{b, c, 7, a) the damping coefficient. It gives the fractional reduction 
in speed between a classical diffusion with drift b and the slowed down 
diffusion with two-phase drift — b when the process is less than distance 7 
from its running maximum, and c when the process is at least distance 7 
from its running maximum. Of course, it is clear that d{b, c, 7) must always 
fall between | and 1 when c G (0, b). We make the following observations: 



DIFFUSION WITH A TWO-PHASE DRIFT 7 

1. When b — )• oo, the damping coefficient d{b,c,j,a) converges to 1 expo- 
nentially in 6; 

2. When 7 — )• 00, d{b, c, 7, a) converges to 1 exponentially in 7; 

3. When c — )• 0, the damping coefficient d{b, c, 7, a) converges to linearly 
in c; 

4. When c — )• and 7 — )• 00, the damping coefficient d(6, c, 7,a) converges 
to 1 (respectively, converges to 0, remains bounded away from and 1) if 
cexp(^) converges to 00 (respectively, converges to 0, remains bounded 
away from and 00); 

5. When c — )• and b — )• 00, the damping coefficient d{b,c,j,a) converges 
to if cexp(^) remains bounded. Otherwise, the damping coefficient con- 
verges to (respectively, converges to 1, remains bounded away from and 
1) if '^^^^^ " ^ converges to (respectively, converges to 00, remains bounded 
away from and 00). 

6. The limiting case c = 00 corresponds to the situation in which the 
value X*{t) — 7 serves as a reflecting barrier for X(t); thus, the process 

can never get farther than a distance 7 from its running maximum. We 

267 

have d{b, 00, 'J, a) = — 267^^ ° 2b^ • For this process, as 7 — )• 00, the speed 

(e~s~+e~~s~ -2) 

satisfies d{b, 00, 7, a)b ~ In particular, the speed approaches infinity and 
the leading order term is independent of b — the process is propelled forward 
by the positive excursions of the Brownian motion with diffusion coefficient 
a. 



In section 2, we present some preliminary information on down-crossings. 
In section 3, we give an explicit representation of the diffusion with a two- 
phase drift in terms of classical diffusions. In section 4 we give a workable 
analytic criterion for transience/recurrence which depends on an auxiliary 
discrete time, increasing Markov process. Sections 5-9 give the proofs of 
Theorems [l][5l 
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2. Preliminaries concerning down-crossings 

Prom the definition of the down-crossing function 7, it follows that x — 
7(x) is increasing. Define the stopping time a-f on continuous paths x(-) : 
[0,00) — R with the standard filtration J^t = a{x{s) : < s < t) by 

= mf{t >0:3s<t with x{t) < x{s) - j{x{s))} = 

mi{t > : x{t) = x*{t) - j(x*{t))}. 

The equality above follows from the fact that x — 7(x) is increasing. Let 

= x*{a-y); 
K'^ = x[a^) = x*[a^) — ^{x*{a^)). 

In the case that the down-crossing function 7 is constant, is the first 
time that the path x(-) completes a down-crossing of an interval of length 
7. The interval that was down-crossed is [K'^^L'^]. In [llj, for 7 constant, 
L'^ was called the "f -down-crossed onset location. In this paper, we will use 
this terminology also for variable 7. We will call the first ^-down-crossed 
time. Por use a bit later, let Tq = inf{t > : x{t) = a} denote the first 
hitting time of the point a. 

Consider now the one-dimensional diffusion process Y{t) which corre- 
sponds to the operator £^ and which is transient to -|-oo. Denote probabil- 
ities for the process starting from x by Px. Pixing a point zq, let 

(2.1) urix) = / exp(- / 2b^{r)dr)dy. 

(The formula in the theorem below is independent of zq, but this specifica- 
tion of Zq will be useful later on.) The following result was proved in [llj. 



Theorem PI. For the diffusion process corresponding to CJ , and for con- 
stant 7, the distribution of the ^-down-crossed onset location L'^ is given 
by 

Px{L^ >x + y) = exp(- / \ -dz), y > 0. 

Jx ut{z) - ut{z - 7) 
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Remark 1. In [TT], where the notation is a bit different from here, the 
mathematical definition of u-y, and consequently also of L'^, were written 
incorrectly. From the verbal description in it is clear that the intended 
definition of L"' is the one given here. All the proofs in [Hj are based on the 
correct definitions given here. 

Remark 2. Theorem P2 in section 1 was proved in [llj as an application 
of Theorem PI. 

The same method of proof used to prove Theorem PI can be used in the 
case of variable 7 to obtain a corresponding formula for the distribution of 



Proposition 1. For the diffusion process corresponding to C , and for vari- 
able 7, the distribution of the ^- down- crossed onset location L'^ is given by 



3. A REPRESENTATION FOR DIFFUSION WITH TWO-PHASE DRIFT 

Consider the diffusion X{t) with the two-phase drift starting from xq. 
Up until the first 7-down-crossed time a^, the process is exactly the Y{-)- 
process corresponding to the operator and starting from xq. We have 
X{a^) = Y{aj) = and X*{a^) = Y*{a^) = L^, with distributed as 
in Proposition [TJ Let 



Then + is the first time after that the process X{-) returns to its 
running maximum . Let Z^'^''^{t) be the diffusion starting from z and 




TLi = inf{i > : X{a^ + t) = L^}. 



corresponding to the operator = i 



1 d2 



_l_ })R,z,T^^^d^ where 



2 dx 




6 (x), X < z; 



= < 



(x), X > z. 
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Then the distribution of {X((7^ + t),0 < t < tl-i}, conditioned on K'^ = 
X{a-y) = z and = X*{a^) = a, is that of {Z^'^'^(t),0 < t < r^}. Of 
course, X{a^ + fit) = X*{a-y + tli) = L'^. Starting from time + tli, 
when the process has returned to its running maximum, X again looks Uke 
the Y process, until it again performs a 7-down-crossing, at which point it 
becomes a Z^'^''^ process for appropriate z until it returns to its running 
maximum, and everything is repeated again. 

In light of the above description, X[t) can be represented as follows. For 
each X G R and each n > 1, let be a diffusion process corresponding 

to the operator £^ and starting from x. Make the processes independent for 
different pairs (n, x). Similarly, for each z € R and each n > 1, let Z^'^''^'^{-) 
be a diffusion process corresponding to the operator and starting from 

z. Make the processes independent for different pairs (n, z) and independent 
of the y"'^ processes. Let o""'^ denote the first 7-down-crossing time for the 
process y"'^, and let r"'^ denote the first hitting time of a for the process 
^R,z,T,n^ Let Lq = xq and then by induction, for n > 1, define LZ to be the 
7-down-crossed onset location for y"'^n-i. For n > 1, let Kn correspond to 
LZ as corresponds to L'^. Then X{-) can be represented as 



(3.1) 



X{t) = Z^'^i •^'i(t), < t < + r^f 1 , 



and for n > 2, 

n—l n— 1 



(3.2) 



3=1 i=i 



From the above representation, it is clear that existence and uniqueness for 
(jl.3p follows from the standard theory for classical diffusion processes. 

T 1 

At those times s when X{s) is running as a y"' "-1 (•)-process, for some 
n > 1, we will say that X{-) is in the y-mode, and at those times s when 
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X{s) is running as a Z^'^"-'^'"'(-)-process, for some n > 1, we will say that 
X(-) is in the Z-mode. We denote by Vxq probabilities corresponding to 
the diffusion X{t) with the two-phase drift starting from xq, and by £xo the 
corresponding expectation. 

Note that {Ll}'^^ Q is a monotone increasing Markov process whose tran- 
sition distribution from a state x is the distribution of in Proposition [TJ 
That is, the transition probability measure p{x, •) is given by 
(3.3) 

p{x, [x + y, oo)) = exp(- / — ^— ---dz), for y > 0. 

Jx ut{z) - ut{z - j{z)) 

We will use the notation to denote probabilities for this discrete time 
Markov process and will denote the corresponding expectation by E^^. The 
times {LnjJ^o ^^^^ called "regeneration" points for X(-) because the Vxq- 
distribution of ''"^ + Yl^= 

1 r^; ' +t),0 < t < oo} given that 
-^n-i = 0^ is the same as the 'Pa-distribution of {X(f),0 <t< oo}. 

4. A transience/recurrence CRITERION 

From the construction in section 3, the well-known equivalent alternative 
conditions for transience/recurrence, which hold for standard non-degenerate 
diffusion processes [T^ , are easily seen to hold for diffusions with a two-phase 
drift. Since it is clear that the process is either transient to -|-oo or recurrent, 
we can use the following criterion: 

(4.1) 

Transience: for some pair of points zq < xq, one has Vxo{tzq = oo) > 0; 
Recurrence: for some pair of points zq < xq, one has Vxai^zo = oo) = 0. 

We choose the point zq so that zq < xq — 7(xo). Then it follows from 
the representation of the process X{-) that at time r^p the process is in the 
Z-mode. Using this with the regeneration structure noted at the end of the 
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previous section, it follows that 

(4.2) V.,{t,, = oo) = E^^^G{{Ll}^^,), 

where for any nondecreasing sequence {an}^=i satisfying ai > xq, we define 

oo 

(4.3) G({a4- i) = n <-;k) < 

n=l 

and where p^'^''^ denotes probabilities for a Z^'^'-^-processes starting at z. 
From dM]) we conclude that Vxoirzo = oo) = if and only if G({L;^}^i) = 
a.s. P^; thus, from (j4.3p we have 
(4.4) 

oo 

^^jR,LZ--,{LZ),Tf 

n=l 



V.,{t,, = oo) = if and only if ^ [pf:t"^^2'^-^'^ [r,, < t^;^)) = oo a.s. P^^ 



As is well known [lOJ, the function v{x) = Px'^''^{tzq < T2+c)i for -^o < 
X < z + c, satisfies C^'^''^v = in {zo,z) U {z,z + c), ^(zo) = l,v{z + 
c) = 0, v{z~) = v{z~^), and ^'(-z^) = v'(z^). Solving this, one finds that 
pR,z,T^^_^^ < r^+c) = v{z) is given by 
(4.5) 

P^^'^^ir^, < r.+c) = 

exp(- J^l {2b^){y)dy) /;+^ dy exp(- /J 26^(r)6;r) 

g dyexpi- Jl 26«(r)dr) + exp(- /;^(26«)(y)dy) dj/exp(- /J 2b^ir)dr 

Analogous to ut in (12. ip . define the function 

(4.6) Uij(x) = / exp(- / 2h^{r)dr)dy. 

J ZQ J ZO 

We then rewrite the somewhat unwieldy equation (j4.5p . which would become 

a lot more unwieldy below, in the form 

(4.7) 

pR,z,T^^ ^ ^ ^ _ ^fi(^)(^T(^: + c) - UTjz)) exp(/^^^ 2b^{y)dy) 

UR{z) + u'^{z){uT{z + c)-UT{z))e-Kp{f^^2b^{y)dy) 

From (14. ip . (14. 4p and (14. 7p . we obtain the following transience/recurrence 
criterion for the diffusion with the two-phase drift. 
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Proposition 2. Define 

(4.8) 
H{s) = 

u'j,is - 7{s)){ut{s) - ut{s - 7(g))) exp(/-^W 2b^{y)dy) 
ur{s - 7(s)) + u'^[s - 7(.)) {ut{s) -ut{s- j{s))) eMi:^^'^ 2bT{y)dy) ' 
Let {LZ}'^=o be the monotone increasing Markov process with Lg = xq and 
transition probability measure p{x,-) given by (j3.3p . // 



^'"^^ — oo a.s., 



(4.9) 5]i/(L^ 

n=0 

then the diffusion with the two-phase drift is recurrent. Otherwise, it is 
transient. 

5. Proof of Theorem [T] 

Proof of TheoremUl By the Ikeda-Watanabe comparison theorem [6], if we 
prove recurrence for the diffusion with the two-phase drift whose recurrent 
drift b^ is replaced by the drift b^ V 0, then original diffusion with the 
two-phase drift is also recurrent. By assumption, the drift 6^ V is also a 
recurrent drift. Thus, we may assume without loss of generality that the 
recurrent drift b^ is nonnegative. 

Since b'^ = b, we have from (j2.ip that 

ut{x) = ^ (^1 - exp ( - 2b{x - zq)) ^ . 

Using this along with the fact that 7 is constant, we have 
(5.1) 

{ut{s) -ut{s --f{s)))exp{J 2b {y)dy) = —{I - exp{-2by)) = Cb,^, 

and thus the formula for H{s) in (j4.8p simplifies to 

Cb,^u'j^{s - 7) 



(5.2) H{s) = - , 

Ur{s - 7) + Cb./U'j^{s - 7) 

From (j4.6p , it follows that ur is increasing, and by the assumption that b^ is 
nonnegative, it follows that u'j^ is non-increasing. Thus, H is non-increasing. 
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We also have 



(5.3) 



u'j,{z) _ 1 _ 1 



ut{z) - ut(z - 7(z)) Cb^j exp(267) d^^^ 



.7 



and thus the increment measure p{x,x + A), A C [0,oo), corresponding to 
the transition probabihty measure p{x, •) in (|3.3p for the Markov process 
{Ln}^=o is independent of x and is equal to the exponential density with 
parameter Consequently, LZ — Lq is the sum of n IID exponential 

random variables with the above parameter, and thus 



Using (|5.4p along with the fact that H is non-increasing, if we show that 
X^J^i H{[dh^'y + l)n) = oo, then it follows that XlJ^i H{Ln) = oo a.s., and 
consequently, from Proposition [2] we conclude that the diffusion with the 
two-phase drift is recurrent. Since u'^ is non-increasing and ur is increasing, 
it is easy to see from (15. 2p that XlJ^i H{[dh^^ + l)n) = oo if and only if 
XlJ^i -^((^^6,7 + l)"-) = oo, where H = . Since H is monotone, it 

follows that ^'^^i H{{di,^^ + l)n) = oo if and only if = oo, that 

is, if and only if lims_j.oo w_r('S) = oo. But this last inequality holds from 
(j4.6p and (jl.ip since is a recurrent drift. □ 

6. Proof of Theorem [2] 

As in the proof of Theorem [H the random variables {LZ — -^^^-il^i are 
IID and distributed according to the exponential distribution with parame- 
ter -f—, and the function H is given by (15. 2p . In order to show transience, 
by Proposition [21 we need to show that X^^g ^{LZ) < oo with positive 
probability. Recalling ()4.6p and (jl.ip . to complete the proof, we will con- 
struct a function ur which satisfies ur > 0, u'^ > and lim^.^oo uji{x) = oo, 
and for which the above sum is almost surely finite. (The corresponding 
drift will then be given by — 



(5.4) 



lim — = db^ a.s. 
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For j > 2, define the interval Ij = [xq — j + j,xo — j + j + ji]- Without 
loss of generality, assume that xq — 7 + 2 > 0. We now show that 

(6.1) P^\iLZ-jeu-L,I,)<^, 

for some c > 0. The distribution of LZ — xq is that of the sum of n IID 
exponential random variables with parameter A = -r—. Thus, its density 
function is "^^^^^i exp(— Ax), x > 0. For an appropriate constant C > 1, we 
then have for n > 3, 

P^^'^iLl - 7 G Uf^^Ij) = E / r^TV exp(-Ax)dx < 

(6.2) ,=2-^^. )■ 
.00 x^x"^-^ . , . , CA^ 



C I rrexpf— Ax)dx 

Jo (n-1)! 



(n-2)(n-2)' 
Now dll]) follows from (lOI) . 

We now construct a positive, strictly increasing C^-function whose de- 
rivative on R—U^2^j is uniformly bounded, and which satisfies uji(x) > x^, 
for X > 2. (Of course, to have this quadratic growth, must get very large 
at certain places on U°^2-^i-) ^^'^ of lai"ge numbers, lim„_j.oo = dfe,7 

a.s. By (^A^ and the lemma of Borel-Cantelh, PJ^^^{Ll-j £ U°^2^j i-O-) = 0- 
Using the facts noted in this paragraph, we conclude that 



C b,^u'j^{LZ - 7) 

^ ; TTo^ \" ^ ^ a.s. 



□ 



7. Proof of Theorem [3] 

Since = 0, we have from (j4.6p that u^{x) = x — zq. Also, 7 is constant. 
Thus, from (j4.8p . we have 

(7 1) /?(.) = /s-7'^/^"P(-/'-7^^^(^)'^^) 

s - 7 + //_^ exp(- 2h^ {r)dr) ' 
By comparison, it suffices to consider the case that 

= ^ log(2) x + -^ log(^) X, 
27 27 
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for X > zq, with zq large enough so that log^'^-' zq is defined. We need to 
show transience for k > 1 and recurrence for k = 1. In what fohows, we will 
always assume that A; > 1. 

We have 
(7.2) 

ry 

(y — s + 7) log''-'^(s — 7) < / log^-'-* rtir < — s + 7) log'--'^ s, s — 7 < y < s. 



Thus, 



< I dyexp{- r 2h^{r)dr)< 



log(^)s + A:log(^)s 

7 

— T^TT T^TT , as s y 00. 

log(2)(s-7) + A;log(3)(s-7) 

From (|7.ip and (j7.3p we conclude that there exist constants Ci , C2 > such 
that 

(7.4) — < H{s) < — for large s. 

s log^ s s log^ ^ s 

We now investigate the growth rate of the Markov process {LZ}^=q- Re- 
call that given Lj = x, the distribution of -^^J+i — L'J is the distribution given 
in (j3.3p . From (|2.ip we have 

7/^(x) _ exp(-X;26^(r)dr) 



nT(x) - ut(x - 7) r dy exp(- P 26^(r)dr) 

(7.5) 

/;_^dyexp(-/J_^26^(r)dr)- 
From (17.21) and the definition of b^, we have 



ci 



^ exp(— / 2b^{r)dr) < j- , for large x, 

(logx)(log*^ x)'= Jx-7 (logx)(log^ x)^ 

for constants ci,C2 > 0. Using this with (|7.3p and (|7.5p . we conclude that 

there exist constants C3, C4 > such that 

(7.6) 

C3 . u'j,{x) C4 

- — r~\ — — 7 \ - Z r, X , -I ' fo^ l3,rge X. 



(logx)(log(^) x)'=-i wr(a;) - ut{x - 7) (logx)(log(^) x)^-i' 
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We now prove recurrence in the case that k = 1. Let {xn}^=Q be a 
sequence of positive numbers with xq sufficiently large so that the bound in 
dM]) holds for X > XQ, and let s„ = E]=oXj- We have /;;_^ j;^dz > 
Using this with (j7.6p and ()3.3p . we have 



(7.7) P^^^iLl - Ll_, < Xn\Ll_, < .„_i) > 1 - exp ( - g^), n > 1. 

Fix a large number M. With xq as above, we wish to select the sequence 
{xn}^=Q so that 

(7.8) — ^ = 21og(n + M), forn > 1. 
log Sn 

We suppress the dependence of this sequence on M in the sequel. For the 
sequence {xn}^^Q satisfying (|7.8p . it follows from (|7.7p that 

oo ^ 

(7-9) P.\{Ll < Sn for an n) > 1 - t;^^^- 

n=l ^ ' 

Now (|7.8p is a difference equation corresponding to the differential equation 
Integrating, it follows that 

(7.11) 5^1^ < 2{t + M)(log(t + M) - 1) + c, 

for some constant c. If one substitutes ^(t + M)(log(t + M)) for 5(t) 
in the left hand side of (j7.1ip . one finds that the resulting expression is 
larger than the right hand side of (j7.1ip for large t. Since the left hand side 
of (j7.1ip is increasing as a function of S{t), (for S{t) > e), it follows that 
Sit) < ^{t + M)(log(t + M))^, for sufficiently large t. It then follows that 
the solution {s„}J!)^q to (|7.8p satisfies 

(7.12) Sn<Sn = C{n + M)[\og{n + M)f, n > 1, 
for some C > 0. 

Now from (j7.9p and (j7.12p we can conclude that with probability at 
least 1 - Y.n=i I^IW' ^""^^ ^" - ^("^ + M)(log(n + M))\ for all 
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n. However, this is not good enough to prove recurrence when k = 1. In 
fact though, from (j7.7p . (|7.9p and (j7.12p . we conclude that with probabil- 
ity at least 1 - Yl'^=i (n+M)'^ ' {L7i}n=i is no larger than {1^}^=!, where 
LZ = xq + X^"=i-^ii and {Zn}^=i is a sequence of independent random 
variables with Z„ ~ Exp(j^^4-). By Kolmogorov's strong law and (|7.12p . 
it follows that "^"pg s almost surely converges to Using this with 
(j7.12p . it follows that {Ln}'^^i almost surely grows on the order nlogn. 
Consequently, with probability at least 1 — J2'^=i (n+M)'^ ' 

grows 

on an order no larger than nlogn. Using this with ()7.4p . it follows that 

Z]^o^(^") = "^i^ii probability at least 1 - XlJ^i {n+M)'^ ■ ^ ^ 
is arbitrary, we conclude that this occurs with probability one, and thus by 
Proposition [2l we conclude that the diffusion with the two-phase drift is 
recurrent. 

We now assume that k > 1 and prove transience. Chose xq sufficiently 
large so that the bound in ()7.6p holds for x > xq. From (j7.6p and (|3.3p . we 
have 

(7.13) Pj^M^, -Ll> x\Ll) > exp ( - 

(logLAjilog'-^'' LA)'' 1 
Thus, it follows from the law of large numbers that 



1 (logL7)(log(2)L7)'=-i 
(7.14) lim -{j < n : L]_^, - L] > ^ ''^ ^ ^} > e 



-1 



a.s. 



The above inequality states that, asymptotically, at least the fraction ^ of 

the increments L'],, — L'] will be of size at least ^ ^ ^ — — . As such, 

it provides a lower bound on the growth rate of {L^}J^q. Since the function 
(logy)(log| ^ y) ' — increasing in y, the "worst case" scenario resulting in 
the least growth would occur if out of the first n increments, the first [^] 
increments satisfied the above condition, and the rest did not. We can thus 
get a lower bound on the growth rate as follows. Making sure that xq > e, 
so that log*-^-* Xq > 0, let {x„}J^q be the sequence defined by 

(l0ggn)(l0g(^^^n)'-^ . „ 

(7.15) Xn+i = 7^ ,n>0, 

O4 
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where Sn = Y1^=q ■ Then it follows from (I7.14p that 

(7.16) P^iLl > S[nj for all large n) = 1. 

As we did in the recurrent case, we analyze the growth rate of {sn}^=o by 
looking at the growth rate of the differential equation associated with the 
above difference equation for {sn}^=Q- The differential equation is 

S'jt) 1 
(log5(t))(log(2)5(f))fe-i 

Integrating this, the leading order term on the left is (j^gg^^^^^igg^l) g(f))fc-i ' 
and thus, for large S{t), we have 

(7.17) >^t + c, 

(log5(t))(log(2)5(t))'=-i - ^4 

for some constant c. If one substitutes 2^*(log t)(log^^'' t)^^"'^ for S{t) in 
(j7.17p . one finds that the resulting expression is smaller than the right 
hand side of (|7.17|) for large t. Since the left hand side of (|7.17|) is in- 
creasing as a function of S{t) (for S{t) sufficiently large), it follows that 
S{t) > 2^t(logt)(log*^^) t)'^~\ for sufficiently large t. It then follows that 
the solution {sn}^=o to ()7.15p satisfies 

(7.18) Sn > Cn(logn)(log(2) n)'''^, n > 3, 
for some C > 0. We conclude from (j7.16p and (|7.18p that 

(7.19) P^oi^l > Con(logn)(log(2) n)^'"^ for all large n) = 1, 

for some Co > 0. From ([719]) and (IZ3D, it follows that Ejr=o^(^") < °° 
a.s., and thus by Proposition [21 we conclude that the diffusion with the 
two-phase drift is transient. □ 

8. Proof of Theorem [H 

By comparison, it suffices to consider the case that 7(x) = ^ log^^^ x + 
^ log^'^^ X, for X > xq, with xq large enough so that log*-'^^ xq is defined. We 
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need to show recurrence in the case that A; = 1, and transience in the case 
that k > 1. 

Since = b, we have similar to ()5.ip . 

(8.1) {uTis)-UT{s--f{s))) exp(^ ^ 26^(y)(iy) = ^(l-exp(-267(s))). 

Since b^ = 0, we have from (j4.6p that u^{x) = x — zq. Thus, from ()4.8p we 
have 

(o o\ H( ') = 1 - exp(-2fc7(s)) 

^' 26(s-zo-7(s)) + l-exp(-267(s))- 

Since 7(5) = o(s), we conclude from (j8.2|) that there exist constants Ci, C2 > 

such that 

(8.3) — < H{s) <—, for large s. 

s s 



We now investigate the growth rate of the Markov process {LZ}°° 



n=o- 



Recall that given Lj = x, the distribution of -^^J+i — L'j is the distri- 
bution given in (j3.3p . Since 6"^ = b, we have from (j2.ip that ut{x) = 
^(l-exp(-26(x-zo))). Thus, 

u'^iz) _ 2b 

ut{z) — ut{z — ^{z)) exp(267(2;)) — 1 

Plugging into this equation the formula for 7(2) given above, we have 

(84) ^t(^) _ 26 

ut{z) - ut{z - -i{z)) {\ogz){\og^'^^ zf - I 

It was shown in the proof of Theorem [3] that if (17. 6p holds, then {LZ}'^^q 

grows at least on the order nlogn(log''^'' n)^~^. Thus, comparing (j8.4p with 

(|7.6p . it follows that in the case at hand {Lj^jJ^Q grows at least on the order 

nlogn(log^^^ n)^. The same method of proof used to prove that if (|7.6p 

holds with k = 1, then {Lj^jJ^Q grows on an order no larger than nlogn, 

also shows that if (|7.6p holds with A; > 1, then {LJ^}J^q grows on an order 

no larger than nlogn(log^^^ n)'^^-'^. Thus, again comparing (j8.4p with (j7.6p . 

it follows that in the case at hand {L^jJ^Q grows on an order no larger than 

nlogn(log^^^ n)^. We conclude that {LnjJ^o grows exactly on the order 
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nlogn(log^'^^ n)^ . Using this with ()8.3[) . it follow from Proposition [2] that 
the diffusion with the two-phase drift is recurrent if A; = 1 and transient if 
k>l. □ 

9. Proof of Theorem [5] 

Recall that the first 7-down-crossed time for the process X{t) is given by 

ay = inf{t >0:3s<t with X{t) < X{s) - 7(X(s))} = 

inf{t > : X{t) = X*{t) - 7(X*(t))}, 

and is a stopping time. Recall that X*{a-y) has been denoted by L"^ and 
that 

= inf{t >0:X{ay + t)= L'^} 

is the first time after a-y that the process X{-) returns to its running max- 
imum L"'. Thus, the process X{-) increases from xq to L'^ from time to 
time a-y + f^i . At the regeneration point L'^ at time o"^ + f^j , everything 
begins anew according to the same rules, and also, according to the same 
distribution, since the two phases of the drift are constants and thus inde- 
pendent of location. If follows from this and the law of large numbers, and 
the standard technique to go from stopping times to deterministic times, 
that 

X(t) SrnL'^ — Xo 

(9.1) lim = a.s. 

t^oo t [Uy + TL-y j 

Recall from the construction in section 3 that X{t) is in the y-mode up 
until time a^. Then from time until time + TLt it is in the Z-mode. 
Under the assumption of the theorem, the Y-mode corresponds to Brownian 
motion with a constant drift b. It follows from Doob's optional stopping 
theorem that X{t A a^) — h{t A a^) is a martingale. Taking expectations, we 
obtain 

(9.2) £xoX{ay At) = xo + b E^^Oy A t. 
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There exists a constant c > such that a Brownian motion with constant 
drift b and starting from any x has probabihty c of downcrossing the interval 
[x— 7, x] within one unit of time. Thus, it fohows that there exists a constant 
Co G (0, 1) such that 

(9.3) Vxoiay >t)< 4, for t > 1. 

We have 
(9.4) 

£x,{X{a^ At);a^ > t) = £x,{X{t);a., > t) < {£x,,X\t))^Vx^{a^ > t))5. 

By comparison, X{t) under V^o is stochastically dominated by xo+^/aW{t)+ 
bt, where is a standard Brownian motion; thus, 

(9.5) S^gX^it) <xl + at + bh + 2xobt. 
Letting f — ^ oo in (19. 2p . and using (I9.3p - ()9.5p . we obtain 

(9.6) £xoX{cr^) = xo + b SxoC^-y 

In the case at hand, where the diffusion coefficient is a instead of 1, 
the function ut is given by f^^ exp(- JJ^ ^dt) = ^(l - exp(-^(x - zq))). 
Similar to (|5.ip and (jS.Sp . it follows that under S^o^ -^'^ ~ is distributed 
according to an exponential distribution with parameter Mr— — ; thus 

aexp(-^)-l 

(9.7) Sx^L-y = xo+ ^ "^^l ' 

Using (j9.6p and (|9.7p . along with the fact that L'^ = X{a^) + 7, we have 

^--^(«r^-)- 

We now evaluate Sx^tli. From the definition of the process and the fact 
that the two drift phases are constants and thus independent of location, it 
follows that under ■, the distribution of f^i is the distribution of the first 
hitting time of 7 by the diffusion process starting at and corresponding to 
the operator L«;c,o,fe = \a-^ + &'^'°'''(x)^, where b'^'^'^i^x) is equal to b when 
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X > and is equal to c when x < 0. Let E^''^'^'^ denote the expectation for 
this diffusion starting from 0. So 

(9.9) £xoT"L-f = -Eq''''°'V^. 

We have £'g''^''^'*r^ = hniTv-s-oo -E'o"^''^'*r^ A t^n- As is well-known [10], 
^a,c,o,6^^ A T-N = vn{0), where vn solves the equation 

= in (-iV,0)u(0,7); 

VN{-N) = VNi7) = 0; 

VNiO-) = fiv(0+), v'^iO') = v'n{0+). 
Solving this, we obtain 

'^^(exp(^)-exp(-2£^))-^, -N<y<0; 
(exp(-2^) - exp(-2^)) + 2^, < y < 7, 

? + f + ^(l-exp(-^)) _ 



VN{y) 

where 



2c 



A 



N 



|:(exp(^)-l) + t(l-exp(-2|l)) 



Dn = An + 1--. 

b c 



From this we obtain 



^0 = J^^-^(O) = + - exp(-— )), 



and thus from (19.9 



(9.10) £x,TLi = - + ^^^^ (1 - exp(- — )). 

The theorem now follows from (f9?T]) . (f977l) . (fa^Sj) and ([9?T0]l . □ 
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